Q APPENDIX A ^ 

Multidimensional Reed-Muller Codes 



This section derives the multidimensional (8,4,4) Reed-Muller codes using the set partitioning , 
techniques in cite: pietrobonl , cite: pietrobon2 . This technique does set partitioning on 
Reed-Muller code spaces instead of lattices to build code spaces. Two-level set partitioning can be 
applied to an (8,4, tfmin = 4) Reed-Muller (i.e. HM(1,3)) code as shown in figure 
( ref: figxodepart ) to yield subcode partition chains cite: forney3 of 

(8,4,4) 3 (8,3,4) 3 (8,2,4) => (8,1,8) - 71A4(0, 3). The Hamming weight of a codeword is 
denoted as wh. At level 1 of the 2-way subgroup code partition, go is the coset leader that is added to 
(8,3,4) Reed-Muller sub-code to form an (8,4,4) Reed-Muller codeword or C (8 ,4,4) = C(8,3,4) © &igo 
where a e {0, 1} and go £ C(8,3,4) md So e C (8 ,4,4). Likewise the level 2, 2-way subgroup code 
partition has the form C( 8 ,4,4) = C (8 ,2,4) © l^Lo^'S'* where a * G md 8i * C(8,2,4) and 
gi e C(8,3,4) or gi € C(8,4.4). The level 3, 2-way subgroup code partition has the form 
C ( 8,4,4) = C(8,i,8) ®Hi^aigi where a,- e {0,1> andg,- £ C (8 ,i (8 ) andg ( - e C( 8(2 ,4) org/ e C (8 ,3,4) or 
gi € C(8,4,4)- Each vector cj = Xl^aigi where j = (a 2 ,ai,ao) 8 . 
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Subgroup code partitions for (8,4,4) Reed-Muller code 
Notice that 3 levels of set partitioning yields a repetition code (8, 1,8) with dmin = 8. It will be 
shown that a simple trellis coded, 2-dimensional (8,4,4) Reed-Muller code can yield a new code 
with rfmin >2x8=16ora potential coding gain of 6 dB. over a (8,4,4) Reed-Muller code. 

Table ( ref: tab:map ) shows the assignment of codewords to branch labels. The branch label 
assignment tries to preserve the conventional labeling schemes for typical modulations such as QAM 
and M-PSK. For example, for 16-QAM a pair of constellations points (0,2) and (0,4) represent a 
sequence of pairs of points that are separated further in Euclidean distance because the numerical 
difference in the points is larger (i.e. (0,4) has larger Euclidean distance than (0,2)). Likewise (0, 8) 
has large Euclidean distance than (0,4) and (0,2). However the Euclidean distance of 16 
constellation points of an (8,4,4) Reed-Muller code space have three distinct Euclidean distances 
which are associated with the codewords having wh as shown in table ( ref: tab:map ). Therefore the 
branch labeling odes not have exactly the same meaning as for conventional modulation 
constellations. For example, the branch label difference between (1,3) or (1,4) does not reflect that 
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the Euclidean distances between these pairs of points are the same. However there is some 
significance for branch labeling when looking at pairs of constellation points that are numerically 
separated by 8 in branch labeling. Pairs (0, 8) and (1,9) have dtain = 8 in Hamming distance per 
dimension. The pairs of codewords associated with the labels are also Boolean complements of each 
other. This property is important when performing set partitioning to yield constellation points with 
Euclidean distances larger than the codewords in an underlying (8,4,4) Reed-Muller code. 



Binary Codeword 


Constellation Point Label 


w H 


(ooooopoo) 


0 


0 


( 0 1 0 1 0 1 0 1 ) 


1 


4 


( 0 0 1 1 0 0 1 1 ) 


2 


4 


( 0 1 1 0 0 1 1 0 ) 


3 


4 


( 0 0 0 0 1 1 1 1 ) 


4 


4 


( 0 1 0 1 1 0 1 0 ) 


5 


4 


( 0 0 1 1 1 1 0 0 ) 


6 


4 


( 0 1 1 0 1 0 0 1 ) 


7 


4 


( 1 1 1 1 1 1 1 1 ) 


8 


8 


( 1 0 1 0 1 0 1 0 ) 


9 


4 


( 1 1 0 0 1 1 0 0 ) 


10 


4 


( 1 0 0 1 1 0 0 1 ) 


11 


4 


( 1 1 1 1 0 0 0 0 ) 


12 


4 


( 1 0 1 0 0 1 0 1 ) 


13 


4 


( 1 1 0 0 0 0 1 1 ) 


14 


4 


( 1 0 0 1 0 1 1 0 ) 


15 


4 



caption [E] 



Using the branch labels in figure ( ref: fig: IDsetpart ), the set partitioning for an (8,4,4) 
Reed-Muller set of codeword "constellation" points is shown. A constellation point in Euclidean 
space is formed by transforming the binary codewords with = (-l) Ca where ajt is a bit in a 
binary codeword c*. Now the Euclidean distance between two codewords c;,c/ is defined as 
d 2 (ci>Cj) = ^ k (bijc - bjjk) 2 . Notice that the minimum Euclidean distance between codeword 
constellation points at each partition level j is denoted as $? fmin therefore 
<5o,min = 16 < 8\ Mn = 16 < 8\ Mn = 16 < 8\ Mri =* 32 where partition level 0 includes all codeword 
labels (0,1,... ,15) 
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Set partitioning 



0,1,2,...,15 




Set partitioning for ID (8,4,4) Reed-Muller code 
Table ( ref: tab:trellislDrm ) shows the set partitions for a 2-D (8,4,4) Reed-Muller code. To 
represent a 2 x (8,4,4) Reed-Muller code, a 2 x 4 binary matrix is formed 



y = 



yi 1 [ y\ y\ y\ y\ 
_ y2 J |_ y\ y\ y\ y\ 



# 



A total of 2 8 = 256 points (i.e. codeword constellation points) represent the unpartitioned signal set. 
Each 2-tuple fyuyi] 7 has two entries that represent a branch (i.e. Reed-Muller codeword) label pair 
in table ( ref: tab:map ). Each branch label can also be represented in binary form in equation 
( ref: eq:2tuple ) where y{ € {0, 1} and yt = Sy] + 4yj + 2yj + yj. The same mechanism for set 
partitioning cite: pietrobon2 is used for a 2 x 8-PSK example with codes and subcodes of a (2,2, 1) 
linear block code. Therefore Co is a (2,2, 1) block code and C\,Ci are subcodes (2, 1,2) and 
(2,0,oo) respectively of Co and Co => C\ 3 Ci. 

This construction has similarities to the treatment of 16 QAM in cite: pietrobonl since there are 
16 (8,4,4) Reed-Muller codewords ("constellation" points). Using the same notation, the minimum 
squared subset distance (MSSD) of a partition is defined as 

Aj > min(5?_i^m M ^?-2^m,_ 2 ,5?_3rf m/ .3, ....,5^ mo ) where / is the set partitioning level of a 
Reed-Muller code as shown in figure ref: figxodepart , mi is the index of binary code C m , used to 
provide the set partitioning at level /, d mi is the Hamming distance of the codewords being used to 
provide set partitioning and 8} is the Euclidean distance between constellation points at level / of the 
1-D constellation points for the Reed-Muller code. Notice that / corresponds to a bit yj in the binary 
representation of a branch label in equation ( ref: eq:2tuple ). For example, to compute the MSSD 
withrfco = l^Ci = 2,dc 2 = oo, then > min(32J 3 , 16^2, 16di, I6d 0 ) and for partition at level 0, 
A§ > min(32</c<p 16rfc 0 , 16rfc 0 > 16^c 0 ) = min(32, 16, 16, 16) = 16. The remaining entries at all other 
partition levels are shown in table ( ref: tab:trellislDrm ). Notice that it is necessary to partition 
down to lowest levels (i.e. p = 5,6,7) to get separation between codewords in Euclidean space to 
get the benefits of trellis coding. (The 1-D codewords have a separation of A 2 = 32.) It will be 
shown that the number of encoder memory stages must be at least 3 (i.e. 8 states of memory) to get 
any benefits of this encoding. 
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[B] 



Level (p) 


Partition fi^ 


MSSD (Ap) 


Generator (t p ) T 


0 


Q(Co, Co, Co, Co) 


min(32, 16, 16, 16) = 16 


[0 .] 




1 


Q(Co, Co, Co, C i ) 


min(32,16,16,32) = 16 






2 


Q(Co,Co,Co, C2) 


min(32, 16, 16,oo) = 16 


[02 




3 


Q(Co,Co,Ci,C2) 


min(32;i6,32,oo) = 16 


[22] 


4 


Q(Co, Co, Cz,Ci) 


min(32, 16,oo,oo) = 16 


[04] 


5 


Q(Co,Ci,C2,Ci) 


min(32, 32,oo, 00) = 32 


[44] 


6 


Q(Co, C2, C2, C2 ) 


min(32, 00, 00,00) = 32 


[ 0 8 




7 


n(Ci,C2,C2,C2) 


min(64,oo,oo,oo) = 64 


[ 8 8 ] 


8 


fi(C2,C2,C2,C2) 


min(oo,oo,oo,oo) = 00 





caption [E] 



Table ( ref : tab:trellislDrm_2 ) shows a different set partitioning of Q°. The number of encoder 
memory stages must be at least 3 (i.e. 8 states of memory) to get any benefits of this encoding. For 
this example, there are more partitions with MSSD > 16 than the previous case. A trellis code 
developed with this partitioning scheme should have better distance properties for the same number 
of trellis states. 

The cosets for partitions QP can be formed as shown in cite: pietrobon2 . For example, 
fiV) = Q} + z°t° mod(16) and Q 2 (2z l + z°) = £2 2 + 2z l t l + z°t° where i e {0, 1>. Using entries 
in table ( ref: tab:trellislDrm ), 



n 2 (2^ 1 +z 0 ) = Q 2 + 2z 1 



1 




0 








1 




1 



and in general a new codeword y(z) = 



■[:] 



mod(16) 

= fi 8 (z) in 2-space is formed as follows 



Viz) = 



-'[:]■ 



[:M:H:] 



] 



mod(16) 



All tuples are formed as shown in equation ( ref: eq:code2D ). Note that partition Q 8 (0) is the all 
"0" codeword or "constellation" point [0,0] r . The encoding is formed using a trellis encoder for 8 



bits z 1 . Note also that the 8 bits in y = 



are not arbitrarily assigned to the 8 bits in z. A 



signal set mapper is used for the assignment which is discussed in detail in section ref: sect:design 
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Soforz= [z 7 ,z 6 ,...,z°] = [ 0 1 0 1 0 0 1 0 ] then 

13 



y(z) = 





0 




0 




1 






8 


+ 


4 


+ 


1 





2-tuple of codewords which correspond to y(z) = 



. The encoding process selects a Reed-Muller 



( 0 1 0 1 0 1 0 1 ) 
( 1 0 1 0 0 1 0 1 ) 



The encoding process is a two step process. First the information bits are mapped from IL - 1 
bits to IL bits which represent z* bits that select a particular coset of Q 8 . Using the same notation as 
in cite: pietrobon2 , / is the number of information bits and L is the dimensionality of the 
multidimensional Reed-Muller code. The next step is to map the intermediate information bits to 
Reed-Muller codewords. The code rate for the new encoding process actually maps IL - 1 
information bits to I L bits where / is the number of encoded bits in a Reed-Muller codeword and L 
is the dimensionality of the multidimensional Reed-Muller code. In general this yields a code of rate 
R = 1^- x -jr- = . For the case / = 4,/ = 8andL = 2 then/? = -^-.ForL = 3, the code rate is 

R = -Jr. Notice that the overall code rate is less than the code rates for 2 or 3 successive 

24 

Reed-Muller codewords respectively (i.e. R = 8/16 and R = 12/24). Trellis encoding is used to (1) 
introduce redundancy beyond that of the information bits of original codeword and (2) provide the 
memory necessary to construct the trellises to give additional coding gain. In order to construct 
Reed-Muller codewords for each dimension it is necessary to have 1 less information bit at the input 
to the multidimensional encoder since the trellis encoder is a rate -^-encoder where k < IL - 1. If it 
is desired to preserve an overall code rate R = 1/2 then a trellis encoder of rate -j^- can be used 
with puncturing applied to the output of the encoder to give a rate of "1". This development will 
nonetheless describe the workings of the trellis encoding using the original constructions in 
cite: pietrobon2 and then describe the performance degradations due to puncturing to preserve the 
code rates of multiple "1-D" Reed-Muller codes. 



[B] 



Level (p) 


Partition QP 


MSSD (A|) 


Generator (t p ) T 


0 


fl(Co, Co, Co, Co) 


min(32,16,16,16) 


= 16 


[o 


>] 


1 


f2(Co, Co, Co, Ci ) 


min(32, 16, 16,32) 


= 16 


[o 




2 


f2(Co,Co,Ci,Ci) 


min(32, 16,32,32) 


= 16 


[o 




3 


Q(Co,Ci,Ci,Ci) 


min(32,32,32,32) 


= 32 


[' 


>] 


4 


fl(Co,Ci,Ci,C2) 


min(32,32,32,oo) 


= 32 






5 


fi(Co,Cl,C2,C2) 


min(32, 32, oo.oo) 


= 32 


[« 




6 


fi(Co,C2,C2,C2) 


min(32, 00,00,00) = 


= 32 


[o 


«] 


7 


n(Ci,C2,C2,C2) 


min(64, oo, 00,00) = 


= 64 


[» 




8 


f2(C2,C2,C2,C2) 


min(oo, oo, oo.oo) = 


= CO 





Each partition is enumerated using 
all pairs of branch labels isa(16x 16 



caption [E] 



a matrix representation. Thus fi° which is the partition with 
matrix of 2-tuples. 
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[:] 

[:] 

[:] 



[:][:] 
[:][:] 

[:][;] 



[':}{"]["}■■["] 



The 2- way partition Q 1 has 128 entries and represents all 2-tuples with even or odd pairs of 
branch labels. There are 64 even pairs and 64 odd pairs of tuples. The other partiton at level 1 is 



o 

Hi 



< 
o 

w 



formed by adding t° to Q l or Q 



Q 1 = 



'd)-nu[°]. 

[:][:][:]-[:] 
[:][:][:] -[i] 



[:][:][:] 

[:][;][;] 

[!] 



[:] 



[:] 



[::] 
[i] 



The 2- way partition Q 2 has 64 entries and represents all 2-tuples with_only even pairs of branch 
labels. The other partitions at level 2 is formed as fi 2 (z) = Q 2 + z 1 * I + z° I ~ I . Therefore 



CM:}- 
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n 2 (2) = n 2 + 



Thus Q 2 (2) is a partition of all odd pairs of tuples in Q 1 



Q 2 = 



[:][;][:] 
[:][;][:] 

[;]["][:] 



n 
u 




14 




2 




14 




14 




14 





Carrying the partitioning to the next level, the 2-way partition Q 3 has 32 entries and further 
partitions branch labels which are even. The otherpartitions at level 3 is formed as 



n 3 (4z 2 + 2z 1 +z°) = Q 3 +z 2 

Thus ft 3 (4) is a partition of al 
"checkerboard" pattern which is a (8 x 4) matrix 



are even, ine other partitions at 

[:M:k:} 



Therefore Q 3 (4) = Q 3 + 



0 
2 



even pairs of tuples in Q 2 . The new matrix representation is a 



n 3 = 



[:] 



[:][:] [i] 
[:][:][;] 

[:][ 



] 



[j] [:][:][»] 

[';][:][::][;:] 



The partition at level 4 is Q 4 and has 16 elements. 
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# 



• 



n 4 = 



[ 
[ 
[ 
[ 



o 



o 



12 
0 



][ 
][ 
][ 
][ 



0 



12 



][ 
][ 
][ 
][ 



0 



12 



][ 
][ 
][ 
][ 



0 
12 



12 



12 



12 
12 



] 
] 
] 
1 



n 4 (8z 3 + 4z 2 + 2z' +z°) = 



•>-«■-[;]•'[;]•■( :]-[:]■ 



Therefore 



fi 4 (8) = Q 4 + z 3 1 ~ | . Notice that Q 3 = Q. 4 U fi 4 (8). The remaining partitions are formed as 
follows, ft 5 is a (4 x 2) matrix of elements 



Q 5 = 



[:][:] 

[:][.'] 

[:][:] 
["]["] 



and 

Q 5 (16z 4 + 8z 3 + 4z 2 + 2z 1 

The remaining partitions are Q 6 ,Q 7 and Q 8 which is just the all "0" codeword. 
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# 



n 6 = 




and finally 



7 _ 



0 
0 



8 
8 



,Q 8 = 



0 
0 



Fractional Dimensional Reed-Muller Composite Codes 

This section describes how set partitioning is performed for trellis-coded fractional dimensional 
Reed-Muller composite codes. Instead of forming the L-fold Cartesian product of the same 
Reed-Muller codewords and L\ x L 2 x . . Cartesian product is formed for a different constituent 
Reed-Muller codewords. Each constituent codeword can conceivably have a different lenght. Letting 
Ni denote the lenght of a constituent Reed-Muller code then the resulting codeword length after the 
Cartesian product is N m = Ni. For example let two constituent codewords be denoted as 
d = C(8,4,4), Ci = C(4,3,2). The N\ = 8,iV 2 = 4. The resulting code C = C\ x C 2 has codeword 
length N m = 12. Under the previous construction, 2 (8,4,4) codes resulting in a 2-dimensional 
Reed-Muller code of length N m = 16. The effective dimension of the L -fold Cartesian product is 
LxN. Now the new code constructed composite Reed-Muller codes has a dimension that is smaller 
than the larger L -fold cartesian product form of the largest constituent code and larger than the 
L -fold cartesian of the smallest constituent code. This construction allows new codes to be 
constructed that have a richer set of code rates and weight spectra properties. For any Reed-Muller 
code denoted as d = C(Ni 9 Ki 9 dt). The overall rate R of the a new code is thus 



R = 



Lit* 



and the new code is denoted as 



M M 



••) 



# 



Continuing the current example, for C\ = C(8,4,4),C2 = C(4,3,2) a new "fractional" dimension 
Reed-Muller is created which is Cm = C(12,6,rffree = *). The resulting code has rate R = y, which 
is the same as the primary constituent code with rate R = y. Furthermore the simple Reed-Muller 
constituent codes can be used for efficient encoding and decoding. Going a few steps further 
Ci = C(8,4,4),C 2 = C(4,3,2),C 3 = C(8,4,4) then Cm = C(20, 10,c/free = *). Using the same 
codes but now Ci = C(8,4,4),C 2 = C(4,3,2),C 3 = C(4,3,2) yields Cm = C(16,9,rffree = *). As 
shown a trelllis-coded, multidimensional Reed-Muller composite codes can be formed of new code 
rates, for systems that require a fixed or higher data user data rate, this construction will be used to 
meet this requirement. If it is desired to use rate 1/2 code for "heavy-coding" of a channel when the 
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• 



constituent code is a (8,4,4) Reed-Muller code then a new code can be constructed with 
C x = C(8,4,4),C 2 = C(4,3,2) andC M = C(12,Mfree = *). The resulting code has rate R = \. 
The properties of the new code are "inherited" from the parent constituent codes and the amount of 
"inheritance" can be adjusted by the set partitioning and the number of memory stages in the 
trellis-encoder. Since the code space of the smaller dimension constituent code is of smaller 
dimensionality than the largest constituent code, the set partitioning can be contrived to exploit the 
characteristics of each particular subspace. Table ( ref: tab:rmcomp2 ) shows examples of 
trellis-coded multidimensional codes Cm that can be contracted from two composite Reed-Muller 
codes C(8,4,4) and C(4,3,2) for 2-fold and 3-fold cartesian products to form fractional dimensional 
composite codes. The minimum distance (d m \ n ) M of the composite code is formed as 
(dmin) m = X)^i(^min), where (dmin),* is the minimum distance for each composite code. The 
resulting codes have code lengths that are not simple powers of 2 nor are the resulting code rates less 
than 1/2 which is a characteristic of most Reed-Muller codes. 



[B] 



Cx 


c 2 


c 3 


Cm 




Code Rate 


C(4,3,2) 


C(4,3,2) 




C(8,5,*) 


4 


5/8 


C(4,3,2) 


C(8,4,4) 




C(12,6,*) 


6 


1/2 


C(8,4,4) 


C(8,4,4) 




C(16,7,*) 


8 


7/16 


C(4,3,2) 


C(4,3,2) 


C(4,3,2) 


C(12,8,*) 


6 


2/3 


C(4,3,2) 


C(4,3,2) 


C(8,4,4) 


C(16,9,*) 


8 


9/16 


C(4,3,2) 


C(8,4,4) 


C(8,4,4) 


C(20,10,*) 


10 


1/2 


C(8,4,4) 


C(8,4,4) 


C(8,4,4) 


C(24,ll,*) 


12 


11/24 



caption [E] 



Table ( ref: tab:rmcomp3 ) shows examples of trellis-coded multidimensional codes Cm that can 
be contracted from three composite Reed-Muller codes with C(16, 5, 8) being the additional 



[B] 



Cx 


Ci 


c 3 


Cm 


(drain) M 


Code Rate 


C(16,5,8) 


C(4,3,2) 


C(4,3,2) 


C(24,10,*) 


12 


5/8 


C(16,5,8) 


C(4,3,2) 


C(8,4,4) 


C(28,H,*) 


14 


11/28 


C(16,5,8) 


C(8,4,4) 


C(8,4,4) 


C(32,12,*) 


16 


3/8 


C(16,5,8) 


C(16,5,8) 


C(4,3,2) 


C(36,12,*) 


18 


1/3 


C(16,5,8) 


C(16,5,8) 


C(8,4,4) 


C(40,13,*) 


20 


13/40 


C(16,5,8) 


C(16,5,8) 


C(16,5,8) 


C(48,14,*) 


24 


7/24 



caption [E] 



In its simplest form, set partitoning for composite codes follows the same methodology as 
presented previously for new codes constructed with codes that are the same. To represent a 
composite code Cm = C(8,4,4) x C(4,3,2) Reed-Muller code, a 2 x 4 binary matrix is formed 



m f yi 1 r y\ y\ y\ 1 



whereyi represents a codeword label for C(8,4,4) andy2 represents a codeword label for C(4,3,2). 
A total of 2 3+4 = 127 points (i.e. codeword constellation points) represent the unpartitioned signal 
set formed from the cartesian product. Each 2-tuple \y\,yt\ T has two entries that represent a branch 
(i.e. Reed-Muller codeword) label pair in table ( ref: tab:map ). Each branch label can also be 
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M 
W 
CO 

Hi 
HI 



u 

O 



m 



represented in binary form in equation ( ref: eq:2tuple ) where yj e {0, 1} and 
y j = %y\ + 4^2 + 2y } + y° x and >>2 = 4)>2 + 2y\ + ^2 • The same mechanism for set partitioning 
cite: pietrobon2 is used with codes and subcodes of a (2,2, 1) linear block code. Therefore Co is a 
(2,2, 1) block code and Ci.Cz are subcodes (2, 1,2) and (2,0,oo) respectively of Co and 
Co Ci => C2. However an additional subcode is introduced C 0 which facilitates the fact that the 
space spanned by yz is of smaller dimension than the space spanned by y 1 . 

► is a subcode of Co and is actually used to "supress" the fourth 



Co- 



IL 0 J L 0 _L 

dimension of yi during set partitioning. Notice that C\ £ Co but Cz a C 0 which implies that the 
benefit of partitioning 



[B] 



Level (p) 


Partition CI" 


MSSD (A|) 


Generator (t p ) T 


0 


fi(Co,Co,Co,Co) 


min(32,16,16,16) = 


= 16 


[ 0 


1] 


1 


fi(C 0 ,Co,Co,Ci) 


min(32, 16, 16,32) = 


= 16 


[ 1 


'] 


2 


Q.(Cq,Co,Co,Ci) 


min(32, 16, 16,oo) = 


16 


[ 0 


*]■ 


3 


n(c 0 ,Co,Ci,C2) 


min(32, 16,32,oo) = 


16 


[ 2 


2] • 


4 


n(c 0 ,Co,C2,C2) 


min(32, 16, 00, 00) = 


16 


[ 0 


«] 


5 


n(c 0 ,Ci,C2,C2) 


min(32, 32,oo,oo) = 


32 


[ 4 


«] 


6 


n(c 0 , C2.C2.C2) 


min(32,co,oo,oo) = 


32 


[ 8 




7 


Q(C2,C2,C2,C2) 


min(oo,oo,oo,oo) = 


00 





caption [E] 



Multidimensional Trellis Encoder/Decoder 
Design 

This section describes the design of the trellis encoder/decoder pair for both the 
multidimensional and coset design of trellis codes. Systematic methods based on cite: calderbank2 , 
cite: turgeon are used to design the convolutional encoder/decoder pairs in general. Issues such as 
rotational invariance are covered in cite: weil , cite: wei2 , cite: wei3 and cite: pietrobon3 . A 
trellis puncturing technique similar to cite: kim is necessary for the (8,4,4) code if overall code 
rates of the new code is to be the same as the "1-D" Reed-Muller codes. A better technique based on 
composite Reed-Muller codes is the preferred approach for designing codes that provide for higher 
user data rates. 



Encoder Designs 

This section describes the design options and the design used to implement the encoder stage. 
Figure ref: fig:encoder shows the overall structure of the encoder as described in 
cite: pietrobon2 , cite: pietrobonl . The key component parts of the encoder include (1) a 
differential precoder to preserve rotational invariance of signal sets (2) a rate R = convolutional 
encoder to provide redundancy in signal space (3) a multidimensional signal set mapper and (4) a 
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Reed-Muller signal set mapper. This design will also how each of these components are developed. 

Encoder System 





Differential 
Precoder 




Binary 
Convolutional 
Encoder 
R = k/(k+l) 


Z 

z 1 i 


Multi-D 
Codeword 
Set Mapper 






X* 




z° 

y 0 ° 








2-D 
Codeword 
set Mapper 



(8,4,4) Codewords J 



Encode System 

There are some simplifications for design step (1) due to the characteristics of rotational 
invariance related to the underlying geometrical properties of Reed-Muller codes. Design steps (2) 
and (3) will be combined using the approach in cite: calderbank2 to devise the convolutional 
encoder by first using products-of-sums expansions to precisely define the convolutional 
encoder/signal mapper. "Optimal" branch assignments to encoder states will use the approach in 
cite: turgeon . Preliminary discussions of design step (4) were described in section ref: sect:Trellis . 

The trellis encoder design will start with the set partitioning shown in table 
( ref: tab:trellislDrm_2 ). This is because by defining the convolutional encoder with rate R = k 
represents the number of partition levels below partition level Q 1 . The parameter k should large 
enough to select a partition with a larger MSSD than SI 1 . Set partitioning yields a larger MSSD 
relative to Q 1 at Q 3 in table ( ref: tab:trellislDrm_2 ) while the MSSD does not increase until Q 5 in 
table ( ref: tab:trellislDrm_2 ). Therefore k > 2 for the encoder. The next step is to determine the 
number of memory states which will be denoted as v. Since the design rules will adhere to 
Ungerboeck's design rules cite: ungerboeck , then the number of states should be at least twice the 
number of states that the encoder can transition to at each time or 2* < 2*~ l or < v - 1, v > 3. 
There should be at least 8 encoder states. Figure ref: fig:trellisencoder shows a high level 
description of the trellis encoder. 

As a preview for the performance analysis, the maximum potential coding gain y should be 
y = 3 dB. because the new minimum distance for the trellis code is 2rfmin = 8 of the trellis coded, 
2-D (8,4,4) Reed-Muller code. For a rate R = 1/2 = 8/16 convolutional code with v = 3, the 
asymptotic coding gain for one of the "optimal" codes cite: lincostello is y - 1.76 dB, = 5. 
For Jfc = 6, v = 7, the maximum potential coding gain turns out to be 6 dB. because the new 
minimum distance for the trellis code is 4rf m i n = 16 of the 2-D, (8,4,4) Reed-Muller code. For a 
comparable "optimal" convolutional code cite: lincostello with v = 7, / = 3.98 dB, = 10. 

Each state represents a set of branch labels that are ordered to reflect how the label edges are 
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# 



assigned for each state transition. Thus state So = £2j and state S\ = Q\ + 



0 
1 



where O! 



denotes the partition at level 1 from table ( ref: tab:trellislDrm_2 ). (Each partition will be denoted 
as Q, p x to distinguish from partitions defined for table ( ref: tab:trellislDrm )). The remaining states 
have the same tuples but the tuples are ordered differently in each state. Thus S2.S4.S6 are 



composed of tuples in Q{ and 5i,53,5s are composed of tuples in Q 



There are 128 



branch label tuples in Q} and since k = 2 there are 4 transitions from each state thus there are 32 
parallel transitions (i.e. branch label tuples) from each state. (Only the transitions from state So are 
shown for brevity.) Each transition from a state is an edge of the trellis and will be denoted as B m%n 
where m is the originating state and n is the branch transition for n = 0, 1, 2, 3. Thus Z?o,o = ft? which 
is the partition for ft } + *. From table ( ref: tab:trellislDrm_2 ), 



2 x (8,4,4) Trellis encoder 




s, 

s 2 

S3 
S4 

s 5 
s 6 

S7 



Trellis Structure for v = 3 states and k = 2 inputs for encoder 
Figure ref: fig:2dsetpart shows the set partitions for the 2-D trellis code. To get Q] first £2}, ft? 
must be formed. Q 1 = Q(Co, Co, Co, C\ ) from table ( ref: tab:trellislDrm_2 ) is the same as Q\ from 
table ( ref: tab:trellislDrm ). Equation ( ref: eq:omega ) shows that Q} * . 
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Set partitioning for 2 x (8,4,4) Reed-Muller code, / = 0, 1,2, 3 
The branch labels for So then become £ 0 ,o = ft?, #o,i = ^i(4), £ 0 ,2 = ^i(2), 5o,3 = Hf(6) . 
The labeling for each Bo, n is an ordered set using additional rules described in cite: turgeon . Using 
these additional rules, the pairs of branch label tuples that are separated by maximum Euclidean 
distance are 

Once the trellis states and transition labels are defined, the convolutional encoder can be 
designed. There are two established techniques to design the convolutional encoder. Figure 

ref: figxcdesign shows the architectures for the two approaches as summarized in cite: turgeon . 
The design of the encoding stage is driven by a set of parameters needed to compute BER 
performance cite: benedetto . 

The convolutional encoders (see figure ref: figxcdesign ) are usually implemented as systematic 
feedback or systematic, feedforward shift register realizations with modulo-2 addition. It has been 
shown that one can convert feedback realizations to feedforward and vice versa cite: porath2 . 
Figure ref: fig:ungccencode shows the architecture of the convolutional encoders used in 

cite: pietrobonl . This is a systematic, feedback convolutional encoder with at most v (X + 1 ) 
encoder tap weights that must be determined from the trellis - which is already defined. There are 

possible binary assignments to the tap weights and only 2* +v state and edge label 
assignments. Therefore there are many systematic, feedback encoder realizations of the trellis. Note 
that there are some assignments that won't realize the desired trellis. Ungerboeck cite: ungerboeck 
devised schemes to perform the search for systematic, feedback encoder realizations which were 
modified slightly by Costello, et al cite: pietrobon2 . The measure is goodness is determined by 
equations ( ref: eq:errorl , ref: eq:errorbit ). Two very efficient algorithms were proposed 

cite: porathl that exploit the growth of the column distance function (CDF) to allow a nested search 
instead of an exhaustive search. An even more efficient search algorithm is proposed by Costello, et 
al cite: malladi but using a systematic, feedforward encoder realization. However to get comparable 
rfftee of systematic, feedback realizations requires constraint lengths that are 2v the size of the 
constraint length for feedback realizations. Another inherent drawback of these realizations is either 
feedforward or feedback is that these are linear codes which might not perform as well as nonlinear 
encoding schemes. 
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Trellis Encoder Designs 




Convolutional Encoder Design Architectures 

U^rboedcGbnvduticrial 
BnoocferEteigTS 




Sytematic Convolutional Encoder with feedback 
Figure ( ref: figrsigmapper ) shows the signal set mapper for coded bits z = [z 7 ,z 6 , - - * 9 z l 9 z°] to 
y u yz where = 0? »y i»y i ,y ? ] andy 2 = fyhyhyiiyi]. The signal mapper represents the realization 
of equation ( ref: eq:code2D ). The two 4-bit outputs y\ 9 y2 of the signal set mapper are'then selected 
by the 2-D codeword selector to form two (8,4,4) Reed-Muller codewords. 
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2 x (8,4,4) Signal Mapper 
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2 x (8,4,4) signal set mapper with modulo-16 addition. 
The lower figure (see figure ( ref: figxcdesign )) shows the approach devised in 
cite: calderbankl , cite: calderbank2 . With this approach the signal mapping function 
x(b i , bi, . . . , &£, b j +1 , . . . , bk, bk+\ , . . . , bk+v) is a function of all inputs and outputs of memory elements 
with bi g {+1,-1}. (This approach also does not necessarily result in a linear "encoding" step as 
does the convolutional encoding approach.) The terms b\ 9 b2 9 ... 9 bj are inputs that impact the 
behavior of the state machine realization of the convolutional code. These terms determine the 
number of transitions from each state where 2 k is the number of transitions. The terms bk+\ , . . bk+v 
are the outputs of the memory elements. Letting n = k + v the signal mapping function can be 
expanded in a sums of products form 

x(bub2,....bn) = do + Em dibt + dijbibj + 5^ d^bibjbu + ... # 

+d\,2,... y nb\b2-..b n 



Equation ( ref: eq:sumprod ) can be solved for do,di,dij, ...,rfi,2,...^. Each product term can then be 
converted into a shift register and combinational logic realization of binary terms. The resulting 
configuration might not be as "optimal" in performance as some of Ungerboeck's approaches. When 
the output signal constellation point is an L-multidimensional, the coordinate label of a signal 
constellation point in each dimension has the form 

Xk = Xk(bub2,.-*<>bn), k = 1,2,...,L, bi = ±1 

Set element labeling is determined by using the "signal difference" rules established in 
cite: turgeon . As a quick review, given a 1 dimensional constellation (e.g. M-AM), a signal 
difference at a particular bit position of the mapping of input bits and encoder memory stages to 
output signal levels is defined as 
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8i = \x(bub2 9 ... 9 bi-\ 9 bu ...,fejt+v) -x(b\ 9 b2 9 ... 9 bi-\ 9 bi 9 ...,^jt+ v ) I 

For an L-multidimensional constellation, a signal difference vector for bit position bi is 
5, = (5 il9 8i 29 5 h9 ... 9 8i L ) where 

8i m - lx m (£i,fr29"MfrM»£M-"*£jkfv^ 

For 2 x (8, 4, 4) Reed-Muller code then 5,- = (8 ix , 5, 2 ). The definition of Si is also modified from 
cite: turgeon since the constellation points in E% for Reed-Muller codewords don't have the same 
distance properties relative to constellation point labels like QAM or Af-PSK. For example let 
x m (b\ 9 b2,..;bi-i 9 Fi 9 ... 9 b k+ v) = 0, then for 16-QAM if 
x m (b\ 9 b2,.-;bi-ub i9 ... 9 bk+v) > x m (bi 9 b2,..;bi-ubi 9 ... 9 b k+v ) then 

i 4 , \xrn( < b\ 9 b29 • • »^bi—\ 9 bi 9 . . -»^Jk+v) ~~ Xm (&i»^2» * • •ib\—\ 9 b'i 9 . . , 9 bfc+v^ Imod(16) ^ 8 
8 , \Xm(b\ 9 b2,.-.ibi-\ 9 bi 9 ... 9 bk+v)~x m (bub2,~*,b^^ > 8 



Equation ( ref: eqisigdiffrm ) reflects that many signal labels map into the same distance thus the 
same signal differences. This redefinition should simply the ordering requirements on signal labels 
that are assigned to trellis states. Figure ( ref: fig:encoderI ) shows an encoder realization for k = 2 
inputs (i.e. b\ 9 b 2 ) that cause the transitions from each state of the trellis in figure ( ref: fig:encoder ). 
There are 3 encoder delay elements with outputs denoted as b& 9 b9,b\o. The number of parallel 
transitions per edge transition is determined by 5 bits 62, b* 9 . . ., bi or 32 parallel transitions. The 
branch labels are the outputs of the mapper function Xi = Xi(b\ 9 bt 9 ...,67,*8,&9»&io), i = 1,2. Let 
each state a be defined as a( at0 ^ 9 ^ 8 ) 8 = o{Aa\o + la? + a%) where 

a ' 2 

The branch edge labels for even number states cr 0,2,4,6 are formed as follows. Let 

5o,2fl,+a 2 = Cl](2a2 + a\ ) where "0" is the state number and a\,ai are the inputs bits that cause state 

transitions. Therefore in vector form 



Bo,* = 



n?(0) 
nf(2) 

Q?(6) 



where Bo,* is a vector of all transitions. The branch labels for state "2" are formed as 



b 2i * = n <8> 



n?(0) 




n?(4) 






n?(2) 


n?(2) 




nf(6) 


n?(6) 




n?(0) 



where fl is a permutation matrix of the form 
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0 


0 


0 


1 


1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


1 


0 



n = 



and ® is the Kronecker product since CI are sets and the goal is to permute the sets of elements. 
Likewise 

B 4 ,* = n 2 ® B 0 ,*,B 6 ,* = TP <8> Bo,* 
for the odd-numbered states the construction is the same which yields 

fi?(5) 

ni(3) 

«?(7) 



Bi. = 



# 



0 

1 



where 2?i,2ai+a 2 

b v = n 1 <g> £i,*,b 5 ,* = n 2 <g> 5i, + ,5 7 ,* = n 3 <g> Si,*, 



and IT is normal matrix multiplication. 



# 



Now that each state is defined by tuple a(&io, b9,b%) and each branch transition is defined by 
equations ( ref: eqrbrl - ref: eq:br5 ), equation ( ref: eq:sumprod ) can be solved for constants 
do,di,dij, ...,</i,2,...n for each dimensional - which is two. 

Given that all trellis branches and state transitions to and from all states are defined a FSM can 
be constructed. The FSM was realized as a large mapping table of the form shown in table 
( ref: tab:FSMtrellis ). For k = 2, inputs bits 61,62 trigger transitions from a current state to a new 
state. Before going to a new state along the appropriate transition, one tuple is selected from the 
coset - at the current state - representing all possible edge labels using k - k bits 63,64,65. 
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[B] 
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caption [E] 





i 
















. » 





label 



Encoder Realization I (k = 2, v = 3) 
The design options have been discussed and now the particular implementation approach is 
described. Although the Ungerboeck approach used convolutional encoders to develop both linear 
and non-linear convolutional codes, the current implementation uses the non-linear approach. As for 
encoding there are two techniques. One technique is to solve for the parameters d and then for each 
input codeword to compute a branch label tuple by multiplying the corresponding row of the 
Hadamard matrix H for all possible bit combinations by d* The encoding steps are 
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1 . At time U form row vector in equation ( ref : eq:encodehad ) of product terms with each set of 
input message bits [61,62, ...,&*] and memory states [bk+\,bk+2,-..,btc+ v ] of the trellis FSM. The 
sums of products expansion is shown in equation ( ref: eqrsumprod ). 

2. Perform vector-matrix multiplication in equation ( ref: eq:encodehad ) to form branch label 
2-tuple jci jc 2 ] 

3. Convert branch label 2-tuple to Reed-Muller binary codewords as per table ( ref: tab:map ). 

4. Modulate binary codewords to BPSK or QPSK constellation points 

5. Use FSM for trellis to compute next state at time t + 1 or 

(6*+t,&*+2»...,&*+v), +1 = 0{(bk+\,bk+2,*.*,bk+v) t \b\,b2,.-.<,bk} 

Go to step (1). 



6 



[ x\ x 2 ] = [ 1 b\ b\b 2 ...b n ] 



dot 



rf(l,2,...n),l d(l,2,...it),2 



Decoder Design 



This section describes the decoder design. Figure ( ref: fig:encoder_4J3 ) and 
( ref: fig:decoder_4_3 ) show the encoder/decoder pair for the case under investigation. The encoder 
has k = 5 input bits and 8 output bits. The 8 output bits are BPSK or QPSK modulated for each 
codeword. This particular configuration has k = 2 input bits out of k = 5 bits used for a trellis finite 
state machine (FSM) designed with v = 3 memory cells. The non-linear mapping function uses 8 
input bits 61,^2, b$,b^bi, b% to generate a 2-tuple branch label for the next state from a current 
state defined by be>,bi>b%. The number of transitions from a current state is 2 1 = 4. The number of 
branch tuples per edge transition is determined by bits 63, 64 and ^5. There are 2 k ' k = 8 possible 
parallel transition per edge in the trellis. For each branch label in each 2-tuple, a (4,3) Reed-Muller 
codeword is formed for each branch label which is then translated into a BPSK or QPSK signal. The 
overall code rate is R = 4- 
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Encoder for 2-D (4, 3) Reed-Muller code 
Figure ( ref: fig:decoder_4_3 ) shows the decoder for the 2-D (4, 3) Reed-Muller code. Input 
message bits with w,*(0 = [b\(t) 9 b2(t) 9 ... 9 bs(t)] are encoded into codeword 2-tuples 
c (0 = [yi(0»y2(^)] r where each yi (0*^2(0 is a (4,3) Reed-Muller codeword. These codewords are 
modulated and transmitted over an AWGN channel with noise n(t). The Viterbi decoder receives 
channel signal r{t) and forms estimates of channel codewords c (f ) and stores accompanying state 
progression information in a trellis. The inverse non-linear mapping function uses both the trellis and 
the decoded codewords c(0 to estimate the input message sequence Hi(t). The trellis contains a 
sequence of states and a set of transitions and codeword vectors where each state contains 
information such as 

• The transitions between states (i.e. bits b \ (t), 62(f)) at eac ^ time epoch for the codeword 
sequence c(t). 

• The current and next states for codeword sequence c(t) (i.e. bits be(t) 9 bi{t) 9 b%(t)) 

• The address label for the 2-tuple selected for estimated codeword c(/), (i.e. bits 
^3(0^4(0^5(0) 

With this information, the estimate of input message by the non-linear mapping becomes 
"i(0 = [6i(0»*2(0>-"»65(0] at each time epoch in the trellis. 
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